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Stochastic networks represent very important subject of research be- 
cause they have been found in almost all branches of modern science, in- 
cluding also sociology and economy. We provide a information theory point 
of view, mostly based on its nonextensive version, on their most character- 
istic properties illustrating it with some examples. 

PACS numbers: PACS 89.75.-k 89.70.+C 24.60.-k 

1. Introduction 

Different kinds of stochastic networks show up in nature whenever one 
is dealing with complex systems of any kind . There are two basic types 
of stochastic networks: 

(a) Networks with constant number of nods, M, for which probability that 
given node has k connections with other nodes (k links) is poissonian 



P(k) = ^ -e-«°; Ko = (k). (1) 
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1 We refer to pP for list of relevant references to which we would like to add recent ap- 
plication of networks to describe some features of multiparticle production processes 
in high energy hadronic collisions 
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(b) Networks in which number of nodes is not stationary and distribution 
of links P(k) is given by dynamics of the growth of network and varies 
between being exponential, 

P(&) = --exp(--V (2) 



m \ m 



(for the case when each new node connects with the already existing ones 
with equal probability Il(fcj) = l/(mo + 1 — 1) independent on hi) or being 
power-like, 

for the case of preferential attachment (the so called " rich-get-richer" mech- 
anism, here m < m.Q is the number of new nodes added in each time step) 
with, in this case, IL(ki) = ki/(2mt) choice. 

Recently we have demonstrated that using information theory approach 
in its nonextensive version (i.e., maximizing Tsallis entropy 5 H q = [1 — 
Efc Pq(k)]/(q ~ 1) under conditions that (k) q = £ fc kP$(k)/ £ fe P$(k) = n 
an d J2k Pq(ty = 1) one obtains that 



P q (k) = - 

KQ 



1 - (1 - q) 

K 



(4) 



which is very universal because for q — ► 1 it recovers eq. (J5J whereas for 
k >> Ko/(q — 1) it leads to the power-like distribution P q (k) oc k q ^ l ~ q \ For 
properly chosen parameters kq and q it is therefore able to describe data 
in the whole region of variable k. As example, in T distribution of WWW 
network after f& with the mean number of connections (k) = 5.46 has been 
described by P q {k) with parameters kq = 1.91 and q = 1.65 obtaining for 
large values of k power-like distribution oc fc~ 7 with 7 = q/(q — 1) = 2.54 
as observed in UJ. Notice that condition of finiteness of the first mo- 
ment of P q (k), equal to (k) = kq/(2 — q), results in the limitation that 
q < 2, whereas similar condition imposed on the variance of P q (k), given by 
Var(k) = Kq/[( 3 ~ 2< ?)( 2 ~ <?) 2 L limits Q further to q < 3/2 (it is worth to 
stress that for q = 3/2, at which variance Var(k) diverges, one gets expo- 
nent 7 = 3, as in eq. ©)• 



Since then detailed analysis of preferential attachment growth and its 
connection with nonextensive statistical mechanics has been performed in 
[7] whereas in |H] it was demonstrated that introducing notion of fluctua- 
tions to a random graph one obtains, as one of the results, the scale-free 
power-like networks (in very much similar way as fluctuations of parameter 



wilk printed on February 2, 2008 



3 



1/m in distribution © given entirely by parameter q lead directly to distri- 
bution P q {k) In what follows we shall provide two additional particular 
examples of using methods described in to analysis of some stochastic 
network features. 



2. Transport on network 

Investigations of transport in the internet |10| II 1 j show that distribu- 
tion of travel times can be described by power distribution of the form 
P(t) oc Such form implies specific dynamic of transport on the net- 

work in which many correlated packets travels at the same time. Detailed 
description of such dynamical picture is particularly complicated because 
of the lack of some global navigation prescription, by the fact that packets 
can be send parallel fashion and, finally, by dependence on the structure of 
network and on the algorithm of selecting the transportation path used. 

To describe this complicated character of transport let us introduce 
transport rate distribution function /(t) and write distribution of the trans- 
portation times as 

P(t) = jHdr/(r)exp(-~). (5) 

Function /(r) can be obtained by considering stochastic process given by 
the following Langevin equation 

dr 

- + [l +m -T = T , (6) 

where £(t) is white gaussian noise with = and (£(t)£(t + At)) = 

2D 5 (/St), parameter tq is the characteristic transport time on network and 
D denotes variation of transport times. Considering now the corresponding 
Fokker-Planck equation one gest (cf. 0) that 2 

where fi = vtq and v = 1/D., i.e., it is given by gamma distribution in 
the variable 1/r. As was shown in 9 such function f(r) results in the 

2 It should be noticed that distribution just obtained is the most expected one 
from the point of view of the maximization of Shannon information entropy, H = 
— (TfcP(fc) In P(k) under constraints that J f{r)dr = 1, (r) = to and (because distri- 
bution we are looking for is defined only for r > 0) that (ln(r)} = ln(ro/D) |12|. 
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power- like distribution of P(t), 



P(t) ' 



TO 



i-(i-<z')- 

T0 



i 

1-9' 



where q' = 1 + D. (8) 



In it has been shown that exactly such form is observed experimentally. 
It means therefore that approach based on Tsallis statistics describes sta- 
tionary states on Internet. 

Power-like asymptotic form of P(t) oc implies existence of long- 

range correlations in the network communication with formation of large 
active aggregates of transportation streams Denoting aggregates by the 
number of active streams existing in time t, K^, these long-range correlations 
are given by autocovariance R(t) = cov(Kt, Kt+ S ) (typically, for the internet 
transport, the written above power-like form of Pit) leads directly to similar 
power-like form of R(t) oc with a € (1, 2)), 

R(t) = J dy[l-F(y)}, (9) 

where F(t) denotes distribuant of P(t) [Tl]. It turns out that using formal- 
ism of random matrices (where matrix elements W« have random proba- 
bility distributions) and identifying the number of decay channels with the 
size K of the aggregate one can immediately obtain that ^5] exponent a 
above is given by the mean size of the aggregate (K): 

a=^± = --l = l(K)-l. (10) 
q'-l D 2 X 1 v ' 

Notice that with increasing size of the aggregate, (K), fluctuations in /(r) 
diminish, ((t _1 — (t -1 )) 2 ) = 2(r _1 } 2 /(iv"), and in the limit of large (K) the 
power- like behavior in (JHJ) becomes exponential one (as now q' — > 1.) 



3. Epidemic dynamics in network 

let us now concentrate on the dynamic of spreading of viruses using 
simple model of the SIS type (susceptible-infects-susceptible). In this model 
each node can be either "healthy" (H) or "infected" (I) and infection spread 
up due to connections between nodes. On every time step node H is infected 
with probability v if it is linked with at least one link with node I. At the 
same time node I is cured with probability 5 (i.e., the mean time of infection 
is equal D = 1/5). Denoting the effective rate of diffusive spreading up the 



wilk printed on February 2, 2008 



■5 



virus by A = u/S it can be shown that probability density of nodes I is 
given by 

p = for A < A c ; 

p oc (A - for A > A c , (11) 

i.e., virus which spreading rate A exceeds the threshold value A c survives 
whereas it quickly vanishes when his spreading rate is below the epidemic 
threshold |171 118j . This threshold depends on the variation of the number 
of connections in the network, A c = (k)/{k 2 ). In regular networks (where 
P(k) = 5(k — ko)) and in stochastic networks (where P{k) is poissonian) 
(k 2 ) is always finite and therefore A c is always greater than zero. Situa- 
tion changes drastically for scale-free networks for which P(k) oc /c~ 7 , with 
7 < 3. In this case for 7^3 one has A c — > and there is no threshold for 
the epidemic 3 . 

Let us analyze this in more detail. Denoting by Xi the part of nodes of 
type i (i.e., with i connections) which are able to be infected and by m the 
part of already infected nodes, one can write following evolution equation 
(where Vij = iju/(k)): 

^ = E *W ^ = Xi H u vVj ~ Vi S - ( 12 ) 

i i 

Solving (|12[) one can shown [Ej that the part of nodes which are always 
infected (it is called the final epidemic size) is given by 

, , , , (k — kex.p(—ka)) . . 

1 = (1 — exp(— ka)) where a = po tt^t • (13) 

{k ) 

Here po = vD{k) is the mean number of the secondary infections caused by 
introducing one infected node in the network (under assumption that each 
node has exactly (k) connections). 

For regular network with P(k) given by Poisson distribution (eq. ([T|)) 
the size of epidemy is 

/= 1-exp [-(£;} (l-e- a )] (14) 
where a is given by the following transcedental equation: 

a = H {1 - exp [-a - (k) (l - e~ a )] } . (15) 



For example, for P(k) given by eq. 0J A c = (3 - 2g)/(2/s ), which for q -» 3/2 tends 
to zero. 
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Assuming small a and keeping in (|15|) only linear terms in a one obtains 
that 



a 



(16) 



from which one can estimate the epidemic threshold (which is for 1 = 0, 
i.e., also for a = 0) as being given by 



Po (k) ' 



(17) 




Fig. 1. Examples of behavior of the final epidemic size I(po) as function of inverse of 
the mean number of secondary infections caused by introduction to network single 
infected virus, po, for network with mean number of connections equal (k) = 4. 
Full line corresponds to poissonian distribution of links (regular networks), dashed 
line is for power- like distributions of links (scale- free networks) . Notice that in the 
later case there are situations in which there is no threshold to epidemic. 



For the scale free network with P{k) given by eq. ©, for small values 
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of po we get the following size of epidemy: 



I ~ 2e a423 • exp [ 



2 

Po 



(18) 



In the general case described by P q (k) as given by eq. Q one has, in the 
approximation that kqo > 1, that 



1 = 1 

where a is given by the equation 

Po 

(k) 



1 



(k) 



a q(2 



a 



1 



a 2 q{2 



(19) 



(20) 



As is clearly demonstrated in Fig. 1 only in the former case there is epi- 
demic threshold, in the later one no such effect appears. 



4. Conclusions 

Stochastic networks represent very complex phenomena of different ori- 
gin. As such they have been also investigated by using statistical mechanic 
approach [^. Here we have shown that they can be also described (at least 
in what concerns some of their most commonly demonstrated properties) 
by using information theory approach based on Tsallis statistics. Such ap- 
proach allows to describe by means of single formula probabilities of number 
of connections in a given network, P q (k), in essentially all kinds of networks, 
from purely exponential ones (with q = 1 to a scale- free power-like ones with 
exponent 7 = q/(q — 1). In this approach it is clear that 7 = 3 found in 
many systems with complex topologies correspond to q = 3/2, a value for 
which variance of P q {k) diverges. 

We have presented two examples of investigations of networks by means 
of Tsallis power- like formula Q), transport on networks and development 
of epidemic on networks. Both have numerous (and still growing) practical 
applications to which others are added (like, for example, description of the 
earthquakes statistics |22|V As example we provide here two result, one 
concerning description of known distributions of sexual partners, in Fig. 2, 
and one illustrating distribution of populations of different agglomerations, 
in Fig. 3. Both can be very well described by means of only two parame- 
ters, kq and q. The later parameter describes, according to ^E||S], in a 
summarily way the influence dynamic of the network (resulting in intrinsic 
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fluctuations, correlations, fractal structure and the like). Let us close with 
remark that different behavior of different epidemics (existence of thresh- 
old or not) is naturally explained by the different character of networks of 
contacts causing infection: those corresponding to regular networks (like, 
for example, flue epidemic mostly following earth communication network) 
show some threshold whereas those corresponding with scale-free networks 
(like, for example AIDS epidemic) have no thresholds. 



10" 



M 
A 



10" 



10 



10" 



-3 



III 










6. V 












o. *\ 




% \ 


1,1,1 





10 



100 



1000 



Fig. 2. Cumulative probability distribution of the number of sexual partners as 
given by [201 compared with eq. I0J for men (full line and symbols; here q = 1.55 
and kq = 0.68 resulting in (fc) = 15) and women (dashed line, open symbols; here 
q = 1.3 and kq = 0.48 resulting in (k) = 7. 



wilk printed on February 2, 2008 



9 



Iff 



10" 



10' 



10' 



10" 



10' 



b) 



I — — I \ I 1 1 — 1 1 — I 

10 3 10 4 10 5 10 6 1 6 10 7 

k k 

Fig. 3. Examples of unnormalized cumulative probability distributions of encoun- 
tering cities in Poland with population greater than some given value k on this 
value, (a), and the same for agglomerations in the whole world, (b). Data (points) 
were taken directly from whereas curves represent fits to Tsallis formula: 
N(> k) — C ■ P q {q) (with the following sets of parameters: C = 1032, n = 7280 
and q = 1.75 for (a) and C = 2362, n = 310000 and q = 1.65 for (b)). For other 
similar results see 
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